Cross-modality mapping using image varifolds to align tissue-scale atlases to molecular-scale measures with application to 2D brain sections.

This paper explicates a solution to building correspondences between molecular-scale transcriptomics and tissue-scale atlases. This problem arises in atlas construction and cross-specimen/technology alignment where specimens per emerging technology remain sparse and conventional image representations cannot efficiently model the high dimensions from subcellular detection of thousands of genes. We address these challenges by representing spatial transcriptomics data as generalized functions encoding position and high-dimensional feature (gene, cell type) identity. We map onto low-dimensional atlas ontologies by modeling regions as homogeneous random fields with unknown transcriptomic feature distribution. We solve simultaneously for the minimizing geodesic diffeomorphism of coordinates through LDDMM and for these latent feature densities. We map tissue-scale mouse brain atlases to gene-based and cell-based transcriptomics data from MERFISH and BARseq technologies and to histopathology and cross-species atlases to illustrate integration of diverse molecular and cellular datasets into a single coordinate system as a means of comparison and further atlas construction.

Grand Challenges at the Interface of Engineering and Medicine.

Over the past two decades Biomedical Engineering has emerged as a major discipline that bridges societal needs of human health care with the development of novel technologies. Every medical institution is now equipped at varying degrees of sophistication with the ability to monitor human health in both non-invasive and invasive modes. The multiple scales at which human physiology can be interrogated provide a profound perspective on health and disease. We are at the nexus of creating "avatars" (herein defined as an extension of "digital twins") of human patho/physiology to serve as paradigms for interrogation and potential intervention. Motivated by the emergence of these new capabilities, the IEEE Engineering in Medicine and Biology Society, the Departments of Biomedical Engineering at Johns Hopkins University and Bioengineering at University of California at San Diego sponsored an interdisciplinary workshop to define the grand challenges that face biomedical engineering and the mechanisms to address these challenges. The Workshop identified five grand challenges with cross-cutting themes and provided a roadmap for new technologies, identified new training needs, and defined the types of interdisciplinary teams needed for addressing these challenges. The themes presented in this paper include: 1) accumedicine through creation of avatars of cells, tissues, organs and whole human; 2) development of smart and responsive devices for human function augmentation; 3) exocortical technologies to understand brain function and treat neuropathologies; 4) the development of approaches to harness the human immune system for health and wellness; and 5) new strategies to engineer genomes and cells.

Space-feature measures on meshes for mapping spatial transcriptomics.

Advances in the development of largely automated microscopy methods such as MERFISH for imaging cellular structures in mouse brains are providing spatial detection of micron resolution gene expression. While there has been tremendous progress made in the field of Computational Anatomy (CA) to perform diffeomorphic mapping technologies at the tissue scales for advanced neuroinformatic studies in common coordinates, integration of molecular- and cellular-scale populations through statistical averaging via common coordinates remains yet unattained. This paper describes the first set of algorithms for calculating geodesics in the space of diffeomorphisms, what we term space-feature-measure LDDMM, extending the family of large deformation diffeomorphic metric mapping (LDDMM) algorithms to accommodate a space-feature action on marked particles which extends consistently to the tissue scales. It leads to the derivation of a cross-modality alignment algorithm of transcriptomic data to common coordinate systems attached to standard atlases. We represent the brain data as geometric measures, termed as space-feature measures supported by a large number of unstructured points, each point representing a small volume in space and carrying a list of densities of features elements of a high-dimensional feature space. The shape of space-feature measure brain spaces is measured by transforming them by diffeomorphisms. The metric between these measures is obtained after embedding these objects in a linear space equipped with the norm, yielding a so-called "chordal metric".

Preserving Derivative Information while Transforming Neuronal Curves.

The international neuroscience community is building the first comprehensive atlases of brain cell types to understand how the brain functions from a higher resolution, and more integrated perspective than ever before. In order to build these atlases, subsets of neurons (e.g. serotonergic neurons, prefrontal cortical neurons etc.) are traced in individual brain samples by placing points along dendrites and axons. Then, the traces are mapped to common coordinate systems by transforming the positions of their points, which neglects how the transformation bends the line segments in between. In this work, we apply the theory of jets to describe how to preserve derivatives of neuron traces up to any order. We provide a framework to compute possible error introduced by standard mapping methods, which involves the Jacobian of the mapping transformation. We show how our first order method improves mapping accuracy in both simulated and real neuron traces under random diffeomorphisms. Our method is freely available in our open-source Python package brainlit.

Amidst an amygdala renaissance in Alzheimer's disease.

The amygdala was highlighted as an early site for neurofibrillary tau tangle pathology in Alzheimer's disease in the seminal 1991 article by Braak and Braak. This knowledge has, however, only received traction recently with advances in imaging and image analysis techniques. Here, we provide a cross-disciplinary overview of pathology and neuroimaging studies on the amygdala. These studies provide strong support for an early role of the amygdala in Alzheimer's disease and the utility of imaging biomarkers of the amygdala in detecting early changes and predicting decline in cognitive functions and neuropsychiatric symptoms in early stages. We summarize the animal literature on connectivity of the amygdala, demonstrating that amygdala nuclei that show the earliest and strongest accumulation of neurofibrillary tangle pathology are those that are connected to brain regions that also show early neurofibrillary tangle accumulation. Additionally, we propose an alternative pathway of neurofibrillary tangle spreading within the medial temporal lobe between the amygdala and the anterior hippocampus. The proposed existence of this pathway is strengthened by novel experimental data on human functional connectivity. Finally, we summarize the functional roles of the amygdala, highlighting the correspondence between neurofibrillary tangle accumulation and symptomatic profiles in Alzheimer's disease. In summary, these findings provide a new impetus for studying the amygdala in Alzheimer's disease and a unique perspective to guide further study on neurofibrillary tangle spreading and the occurrence of neuropsychiatric symptoms in Alzheimer's disease.

STalign: Alignment of spatial transcriptomics data using diffeomorphic metric mapping.

Spatial transcriptomics (ST) technologies enable high throughput gene expression characterization within thin tissue sections. However, comparing spatial observations across sections, samples, and technologies remains challenging. To address this challenge, we develop STalign to align ST datasets in a manner that accounts for partially matched tissue sections and other local non-linear distortions using diffeomorphic metric mapping. We apply STalign to align ST datasets within and across technologies as well as to align ST datasets to a 3D common coordinate framework. We show that STalign achieves high gene expression and cell-type correspondence across matched spatial locations that is significantly improved over landmark-based affine alignments. Applying STalign to align ST datasets of the mouse brain to the 3D common coordinate framework from the Allen Brain Atlas, we highlight how STalign can be used to lift over brain region annotations and enable the interrogation of compositional heterogeneity across anatomical structures. STalign is available as an open-source Python toolkit at https://github.com/JEFworks-Lab/STalign and as Supplementary Software with additional documentation and tutorials available at https://jef.works/STalign .

BME 2.0: Engineering the Future of Medicine.

If the 20th century was the age of mapping and controlling the external world, the 21st century is the biomedical age of mapping and controlling the biological internal world. The biomedical age is bringing new technological breakthroughs for sensing and controlling human biomolecules, cells, tissues, and organs, which underpin new frontiers in the biomedical discovery, data, biomanufacturing, and translational sciences. This article reviews what we believe will be the next wave of biomedical engineering (BME) education in support of the biomedical age, what we have termed BME 2.0. BME 2.0 was announced on October 12 2017 at BMES 49 (https://www.bme.jhu.edu/news-events/news/miller-opens-2017-bmes-annual-meeting-with-vision-for-new-bme-era/). We present several principles upon which we believe the BME 2.0 curriculum should be constructed, and from these principles, we describe what view as the foundations that form the next generations of curricula in support of the BME enterprise. The core principles of BME 2.0 education are (a) educate students bilingually, from day 1, in the languages of modern molecular biology and the analytical modeling of complex biological systems; (b) prepare every student to be a biomedical data scientist; (c) build a unique BME community for discovery and innovation via a vertically integrated and convergent learning environment spanning the university and hospital systems; (d) champion an educational culture of inclusive excellence; and (e) codify in the curriculum ongoing discoveries at the frontiers of the discipline, thus ensuring BME 2.0 as a launchpad for training the future leaders of the biotechnology marketplaces. We envision that the BME 2.0 education is the path for providing every student with the training to lead in this new era of engineering the future of medicine in the 21st century.

Erratum to "BME 2.0: Engineering the Future of Medicine".

[This corrects the article DOI: 10.34133/bmef.0001.].

Longitudinal imaging highlights preferential basal ganglia circuit atrophy in Huntington's disease.

Huntington's disease is caused by a CAG repeat expansion in the Huntingtin gene (HTT), coding for polyglutamine in the Huntingtin protein, with longer CAG repeats causing earlier age of onset. The variable 'Age' × ('CAG'-L), where 'Age' is the current age of the individual, 'CAG' is the repeat length and L is a constant (reflecting an approximation of the threshold), termed the 'CAG Age Product' (CAP) enables the consideration of many individuals with different CAG repeat expansions at the same time for analysis of any variable and graphing using the CAG Age Product score as the X axis. Structural MRI studies have showed that progressive striatal atrophy begins many years prior to the onset of diagnosable motor Huntington's disease, confirmed by longitudinal multicentre studies on three continents, including PREDICT-HD, TRACK-HD and IMAGE-HD. However, previous studies have not clarified the relationship between striatal atrophy, atrophy of other basal ganglia structures, and atrophy of other brain regions. The present study has analysed all three longitudinal datasets together using a single image segmentation algorithm and combining data from a large number of subjects across a range of CAG Age Product score. In addition, we have used a strategy of normalizing regional atrophy to atrophy of the whole brain, in order to determine which regions may undergo preferential degeneration. This made possible the detailed characterization of regional brain atrophy in relation to CAG Age Product score. There is dramatic selective atrophy of regions involved in the basal ganglia circuit-caudate, putamen, nucleus accumbens, globus pallidus and substantia nigra. Most other regions of the brain appear to have slower but steady degeneration. These results support (but certainly do not prove) the hypothesis of circuit-based spread of pathology in Huntington's disease, possibly due to spread of mutant Htt protein, though other connection-based mechanisms are possible. Therapeutic targets related to prion-like spread of pathology or other mechanisms may be suggested. In addition, they have implications for current neurosurgical therapeutic approaches, since delivery of therapeutic agents solely to the caudate and putamen may miss other structures affected early, such as nucleus accumbens and output nuclei of the striatum, the substantia nigra and the globus pallidus.

Mixed longitudinal and cross-sectional analyses of deep gray matter and white matter using diffusion weighted images in premanifest and manifest Huntington's disease.

Changes in the brain of patients with Huntington's disease (HD) begin years before clinical onset, so it remains critical to identify biomarkers to track these early changes. Metrics derived from tensor modeling of diffusion-weighted MRIs (DTI), that indicate the microscopic brain structure, can add important information to regional volumetric measurements. This study uses two large-scale longitudinal, multicenter datasets, PREDICT-HD and IMAGE-HD, to trace changes in DTI of HD participants with a broad range of CAP scores (a product of CAG repeat expansion and age), including those with pre-manifest disease (i.e., prior to clinical onset). Utilizing a fully automated data-driven approach to study the whole brain divided in regions of interest, we traced changes in DTI metrics (diffusivity and fractional anisotropy) versus CAP scores, using sigmoidal and linear regression models. We identified points of inflection in the sigmoidal regression using change-point analysis. The deep gray matter showed more evident and earlier changes in DTI metrics over CAP scores, compared to the deep white matter. In the deep white matter, these changes were more evident and occurred earlier in superior and posterior areas, compared to anterior and inferior areas. The curves of mean diffusivity vs. age of HD participants within a fixed CAP score were different from those of controls, indicating that the disease has an additional effect to age on the microscopic brain structure. These results show the regional and temporal vulnerability of the white matter and deep gray matter in HD, with potential implications for experimental therapeutics.

Automatic comprehensive radiological reports for clinical acute stroke MRIs.

BACKGROUND: Although artificial intelligence systems that diagnosis among different conditions from medical images are long term aims, specific goals for automation of human-labor, time-consuming tasks are not only feasible but equally important. Acute conditions that require quantitative metrics, such as acute ischemic strokes, can greatly benefit by the consistency, objectiveness, and accessibility of automated radiological reports. METHODS: We used 1,878 annotated brain MRIs to generate a fully automated system that outputs radiological reports in addition to the infarct volume, 3D digital infarct mask, and the feature vector of anatomical regions affected by the acute infarct. This system is associated to a deep-learning algorithm for segmentation of the ischemic core and to parcellation schemes defining arterial territories and classically-identified anatomical brain structures. RESULTS: Here we show that the performance of our system to generate radiological reports was comparable to that of an expert evaluator. The weight of the components of the feature vectors that supported the prediction of the reports, as well as the prediction probabilities are outputted, making the pre-trained models behind our system interpretable. The system is publicly available, runs in real time, in local computers, with minimal computational requirements, and it is readily useful for non-expert users. It supports large-scale processing of new and legacy data, enabling clinical and translational research. CONCLUSION: The generation of reports indicates that our fully automated system is able to extract quantitative, objective, structured, and personalized information from stroke MRIs.

Artificial intelligence (AI) uses computer software to solve problems that normally require human input. It is likely that AI will take over, or help with, certain tasks in medical imaging, particularly where these tasks are time-consuming and laborious for clinicians. Here, we demonstrate the possibility of using AI to generate radiological reports for brain scans from patients who have had a stroke. These reports provide a summary of what is shown in the scans, and are normally written by clinicians. Our system performs similarly to human experts, is fast, publicly available, and runs on normal computers with minimal computational requirements, meaning that it might be a useful tool for researchers and clinicians to use when assessing and treating patients with stroke.

Alignment of spatial transcriptomics data using diffeomorphic metric mapping.

Spatial transcriptomics (ST) technologies enable high throughput gene expression characterization within thin tissue sections. However, comparing spatial observations across sections, samples, and technologies remains challenging. To address this challenge, we developed STalign to align ST datasets in a manner that accounts for partially matched tissue sections and other local non-linear distortions using diffeomorphic metric mapping. We apply STalign to align ST datasets within and across technologies as well as to align ST datasets to a 3D common coordinate framework. We show that STalign achieves high gene expression and cell-type correspondence across matched spatial locations that is significantly improved over landmark-based affine alignments. Applying STalign to align ST datasets of the mouse brain to the 3D common coordinate framework from the Allen Brain Atlas, we highlight how STalign can be used to lift over brain region annotations and enable the interrogation of compositional heterogeneity across anatomical structures. STalign is available as an open-source Python toolkit at https://github.com/JEFworks-Lab/STalign and as supplementary software with additional documentation and tutorials available at https://jef.works/STalign.

Preserving Derivative Information while Transforming Neuronal Curves.

The international neuroscience community is building the first comprehensive atlases of brain cell types to understand how the brain functions from a higher resolution, and more integrated perspective than ever before. In order to build these atlases, subsets of neurons (e.g. serotonergic neurons, prefrontal cortical neurons etc.) are traced in individual brain samples by placing points along dendrites and axons. Then, the traces are mapped to common coordinate systems by transforming the positions of their points, which neglects how the transformation bends the line segments in between. In this work, we apply the theory of jets to describe how to preserve derivatives of neuron traces up to any order. We provide a framework to compute possible error introduced by standard mapping methods, which involves the Jacobian of the mapping transformation. We show how our first order method improves mapping accuracy in both simulated and real neuron traces, though zeroth order mapping is generally adequate in our real data setting. Our method is freely available in our open-source Python package brainlit.

A Universal Method for Crossing Molecular and Atlas Modalities using Simplex-Based Image Varifolds and Quadratic Programming.

This paper explicates a solution to the problem of building correspondences between molecular-scale transcriptomics and tissue-scale atlases. The central model represents spatial transcriptomics as generalized functions encoding molecular position and high-dimensional transcriptomic-based (gene, cell type) identity. We map onto low-dimensional atlas ontologies by modeling each atlas compartment as a homogeneous random field with unknown transcriptomic feature distribution. The algorithm presented solves simultaneously for the minimizing geodesic diffeomorphism of coordinates and latent atlas transcriptomic feature fractions by alternating LDDMM optimization for coordinate transformations and quadratic programming for the latent transcriptomic variables. We demonstrate the universality of the algorithm in mapping tissue atlases to gene-based and cell-based MERFISH datasets as well as to other tissue scale atlases. The joint estimation of diffeomorphisms and latent feature distributions allows integration of diverse molecular and cellular datasets into a single coordinate system and creates an avenue of comparison amongst atlas ontologies for continued future development.

Automatic comprehensive aspects reports in clinical acute stroke MRIs.

The Alberta Stroke Program Early CT Score (ASPECTS) is a simple visual system to assess the extent and location of ischemic stroke core. The capability of ASPECTS for selecting patients' treatment, however, is affected by the variability in human evaluation. In this study, we developed a fully automatic system to calculate ASPECTS comparable with consensus expert readings. Our system was trained in 400 clinical diffusion weighted images of patients with acute infarcts and evaluated with an external testing set of 100 cases. The models are interpretable, and the results are comprehensive, evidencing the features that lead to the classification. This system adds to our automated pipeline for acute stroke detection, segmentation, and quantification in MRIs (ADS), which outputs digital infarct masks and the proportion of diverse brain regions injured, in addition to the predicted ASPECTS, the prediction probability and the explanatory features. ADS is public, free, accessible to non-experts, has very few computational requirements, and run in real time in local CPUs with a single command line, fulfilling the conditions to perform large-scale, reproducible clinical and translational research.

Preserving Derivative Information while Transforming Neuronal Curves.

The international neuroscience community is building the first comprehensive atlases of brain cell types to understand how the brain functions from a higher resolution, and more integrated perspective than ever before. In order to build these atlases, subsets of neurons (e.g. serotonergic neurons, prefrontal cortical neurons etc.) are traced in individual brain samples by placing points along dendrites and axons. Then, the traces are mapped to common coordinate systems by transforming the positions of their points, which neglects how the transformation bends the line segments in between. In this work, we apply the theory of jets to describe how to preserve derivatives of neuron traces up to any order. We provide a framework to compute possible error introduced by standard mapping methods, which involves the Jacobian of the mapping transformation. We show how our first order method improves mapping accuracy in both simulated and real neuron traces under random diffeomorphisms. Our method is freely available in our open-source Python package brainlit.

BrainLine: An Open Pipeline for Connectivity Analysis of Heterogeneous Whole-Brain Fluorescence Volumes.

Whole-brain fluorescence images require several stages of computational processing to fully reveal the neuron morphology and connectivity information they contain. However, these computational tools are rarely part of an integrated pipeline. Here we present BrainLine, an open-source pipeline that interfaces with existing software to provide registration, axon segmentation, soma detection, visualization and analysis of results. By implementing a feedback based training paradigm with BrainLine, we were able to use a single learning algorithm to accurately process a diverse set of whole-brain images generated by light-sheet microscopy. BrainLine is available as part of our Python package brainlit: http://brainlit.neurodata.io/ .

Early amygdala and ERC atrophy linked to 3D reconstruction of rostral neurofibrillary tau tangle pathology in Alzheimer's disease.

Previous research has emphasized the unique impact of Alzheimer's Disease (AD) pathology on the medial temporal lobe (MTL), a reflection that tau pathology is particularly striking in the entorhinal and transentorhinal cortex (ERC, TEC) early in the course of disease. However, other brain regions are affected by AD pathology during its early phases. Here, we use longitudinal diffeomorphometry to measure the atrophy rate from MRI of the amygdala compared with that in the ERC and TEC in cognitively unimpaired (CU) controls, CU individuals who progressed to mild cognitive impairment (MCI), and individuals with MCI who progressed to dementia of the AD type (DAT), using a dataset from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Our results show significantly higher atrophy rates of the amygdala in both groups of 'converters' (CU→MCI, MCI→DAT) compared to controls, with rates of volume loss comparable to rates of thickness loss in the ERC and TEC. We localize atrophy within the amygdala within each of these groups using fixed effects modeling. Controlling for the familywise error rate highlights the medial regions of the amygdala as those with significantly higher atrophy in both groups of converters than in controls. Using our recently developed method, referred to as Projective LDDMM, we map measures of neurofibrillary tau tangles (NFTs) from digital pathology to MRI atlases and reconstruct dense 3D spatial distributions of NFT density within regions of the MTL. The distribution of NFTs is consistent with the spatial distribution of MR measured atrophy rates, revealing high densities (and atrophy) in the amygdala (particularly medial), ERC, and rostral third of the MTL. The similarity of the location of NFTs in AD and shape changes in a well-defined clinical population suggests that amygdalar atrophy rate, as measured through MRI may be a viable biomarker for AD.

Digital 3D Brain MRI Arterial Territories Atlas.

The locus and extent of brain damage in the event of vascular insult can be quantitatively established quickly and easily with vascular atlases. Although highly anticipated by clinicians and clinical researchers, no digital MRI arterial atlas is readily available for automated data analyses. We created a digital arterial territory atlas based on lesion distributions in 1,298 patients with acute stroke. The lesions were manually traced in the diffusion-weighted MRIs, binary stroke masks were mapped to a common space, probability maps of lesions were generated and the boundaries for each arterial territory was defined based on the ratio between probabilistic maps. The atlas contains the definition of four major supra- and infra-tentorial arterial territories: Anterior, Middle, Posterior Cerebral Arteries and Vertebro-Basilar, and sub-territories (thalamoperforating, lenticulostriate, basilar and cerebellar arterial territories), in two hierarchical levels. This study provides the first publicly-available, digital, 3D deformable atlas of arterial brain territories, which may serve as a valuable resource for large-scale, reproducible processing and analysis of brain MRIs of patients with stroke and other conditions.